Asymmetric zones in a fresnel lens

ABSTRACT

A Fresnel lens includes multiple different zones. At least one of the zones may be an asymmetric zone that is radially asymmetric. The asymmetric zone may redirect light received from a light source located within a focal length of the Fresnel lens to a portion of a field of view of an image sensor. In some embodiments, multiple asymmetric zones may be implemented within the same Fresnel lens, which may have different radial asymmetry.

RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/884,233, filed Jan. 30, 2018, which claims benefit of priority toU.S. Provisional Application Ser. No. 62/454,679, filed Feb. 3, 2017,which are hereby incorporated herein by reference in their entirety.

BACKGROUND

When capturing image data using an image sensor or other image capturedevice, such as a camera, it is common to include a flash, strobe, orother component that uses an illumination element, such as a lightemitting diode (LED), that emits light to illuminate portions of a scenelocated within a field of view of the image sensor. As image sensors areoften embedded in a wide variety of devices, different types of flashcomponents may be implemented to suit the constraints or designrequirements of the different devices that include the image sensors.For example, mobile computing devices, such as mobile phones or otherportable multi-function devices, may implement image sensors and flashcomponents that occupy a limited portion of the mobile computing device,leaving space for other elements or components of the mobile computingdevice to provide other functions or capabilities. Therefore, techniquesto reduce the space or resources occupied by flash components or imagesensors may be desirable.

SUMMARY

In various embodiments, a Fresnel lens may be implemented to illuminatea scene or other portion within the field of view of an image sensor,directing light received from an illumination element or other lightsource into the field of view. The Fresnel lens may include multipledifferent zones for directing received light. While one or more of thezones in the Fresnel lens may be radially symmetric, another one or moreof the zones may be asymmetric, resulting in a zone that is radiallyasymmetric. The asymmetric zone may provide localized redirection oflight so that different portions of the asymmetric zone direct lightdifferently. One embodiment of an asymmetric zone may, for instance,redirect light to provide inverted illumination in the field of view,while another embodiment of an asymmetric zone may redirect light toprovide a non-inverted illumination in the field of view. Differentcombinations of multiple asymmetric zones may be implemented within asingle Fresnel lens or multiple Fresnel lenses implemented together aspart of a same light source module.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A-1C illustrate different optical systems that include differentFresnel lenses and light source placements, including a Fresnel lenswith an asymmetric zone, according to some embodiments.

FIG. 2 illustrates a Fresnel lens that includes an asymmetric zone,according to some embodiments.

FIGS. 3A-3C illustrates example cross sections of different asymmetriczones of a Fresnel lens, according to some embodiments.

FIG. 4 illustrates a Fresnel lens with multiple asymmetric zones thatredirect light to different portions of a field of view, according tosome embodiments.

FIG. 5 illustrates a mobile computing device that implements an embeddedlight module that includes a Fresnel lens with asymmetric zone(s) andprovides illumination for an image sensor, according to someembodiments.

FIG. 6 illustrates a logical block diagram of a controller and lightsource module, according to some embodiments.

FIGS. 7A-7C illustrate a portable multifunction device with an embeddedlight source module, according to some embodiments.

This specification includes references to “one embodiment” or “anembodiment.” The appearances of the phrases “in one embodiment” or “inan embodiment” do not necessarily refer to the same embodiment.Particular features, structures, or characteristics may be combined inany suitable manner consistent with this disclosure.

“Comprising.” This term is open-ended. As used in the appended claims,this term does not foreclose additional structure or steps. Consider aclaim that recites: “An apparatus comprising one or more processor units. . . .” Such a claim does not foreclose the apparatus from includingadditional components (e.g., a network interface unit, graphicscircuitry, etc.).

“Configured To.” Various units, circuits, or other components may bedescribed or claimed as “configured to” perform a task or tasks. In suchcontexts, “configured to” is used to connote structure by indicatingthat the units/circuits/components include structure (e.g., circuitry)that performs those task or tasks during operation. As such, theunit/circuit/component can be said to be configured to perform the taskeven when the specified unit/circuit/component is not currentlyoperational (e.g., is not on). The units/circuits/components used withthe “configured to” language include hardware—for example, circuits,memory storing program instructions executable to implement theoperation, etc. Reciting that a unit/circuit/component is “configuredto” perform one or more tasks is expressly intended not to invoke 35U.S.C. § 112(f) for that unit/circuit/component. Additionally,“configured to” can include generic structure (e.g., generic circuitry)that is manipulated by software and/or firmware (e.g., an FPGA or ageneral-purpose processor executing software) to operate in manner thatis capable of performing the task(s) at issue. “Configure to” may alsoinclude adapting a manufacturing process (e.g., a semiconductorfabrication facility) to fabricate devices (e.g., integrated circuits)that are adapted to implement or perform one or more tasks.

“First,” “Second,” etc. As used herein, these terms are used as labelsfor nouns that they precede, and do not imply any type of ordering(e.g., spatial, temporal, logical, etc.). For example, a buffer circuitmay be described herein as performing write operations for “first” and“second” values. The terms “first” and “second” do not necessarily implythat the first value must be written before the second value.

“Based On.” As used herein, this term is used to describe one or morefactors that affect a determination. This term does not forecloseadditional factors that may affect a determination. That is, adetermination may be solely based on those factors or based, at least inpart, on those factors. Consider the phrase “determine A based on B.”While in this case, B is a factor that affects the determination of A,such a phrase does not foreclose the determination of A from also beingbased on C. In other instances, A may be determined based solely on B.

DETAILED DESCRIPTION

Various embodiments may implement an asymmetric zone in a Fresnel lens.In order to capture image data for an event, object, or other scene inthe field of view of an image sensor, additional light may be focused orotherwise directed into the field of view. In this way, deficiencies orcharacteristics of natural or other lighting may be balanced,counteracted, or otherwise compensated for within the field of view. Todirect light into the field of view, different types of lenses orreflectors may be implemented to receive and redirect light into thefield of view. For example, a total internal reflective (TIR) lens or acurved reflector may redirect and concentrate received light into aparticular direction, pattern, or location within the field of view.

A Fresnel lens may be implemented, in various embodiments, to receivelight emitted from a light source, in order to redirect the light into afield of view of an image sensor. A Fresnel lens may implement multiplezones. Each zone may include one or more sub-zones. A sub-zone mayinclude one or more segments or surface elements (e.g., ridges, “teeth”,grooves, or other features, like prisms) that redirect light in order toilluminate different or the same portions of a field of view for theimage sensor. Each sub-zone within a same zone may share one or morecharacteristics across the zone. For example, the type of sub-zone,symmetric or asymmetric, may be shared by two sub-zones in a same zone(as discussed below in FIGS. 3A-3C). Sub-zones may also have differentcharacteristics within a same zone. For instance, a zone may include twoasymmetric sub-zones each with different forms of asymmetry (e.g.,different surface measurements at different locations in the zone) or azone may include both an asymmetric sub-zone and symmetric sub-zone.

A sub-zone may be described in different ways. A “tooth” segment, suchas the “teeth” segments illustrated in FIGS. 1-4, may be defined by an aangle with respect to an inner surface (with respect to the center ofthe Fresnel lens) of the segment, a β angle with respect to an outersurface (with respect to the center of the Fresnel lens) of the segment,and a surface radius R_(o) for the outer surface. The inner surface andouter surface of the segment may be joined together at a “peak” of the“tooth.” Note that other measurements may be used to describe a segment.The radius R_(I) for the inner surface may also be described, as can theheight of the peak or length of a surface, in various embodiments.Sub-zones may adjoin one another. In the “tooth” example given above,the outer surface of one “tooth” may join the inner surface of anadjacent “tooth” as a “valley” between the “peaks” of the “teeth.” Insome embodiments, a sub-zone may not traverse the entire circumferencearound the center of a lens, as illustrated in FIG. 4 for example.

Different zones (or sub-zones) of the Fresnel lens may receive lightfrom the light source at different angles (e.g., because of a 180°spread from a light source). The zones may then collimate the light fromthe different angles so that the light is redirected out from theFresnel lens in parallel directions. Typically, a Fresnel lens mayimplement zones that include symmetric zones with symmetric sub-zonesand/or segments in order to redirect received light from a light sourceinto space. For example, as illustrated in FIG. 1A, light source 103 mayemit light that is received at Fresnel lens with symmetric zones 107 andredirected to provide an illumination pattern 109 in object space. Insuch an implementation, light source 103 is placed at distance from theFresnel lens 107 that is equivalent to a focal length 110 of Fresnellens 107, which may achieve an illumination uniformity of greater than50%. Such illumination uniformity may be highly desirable in order toprovide uniform effect to balance, counteract, or compensate for otherlight sources captured in the field of view.

A focal length of a Fresnel lens, such as Fresnel lens 107 may bedetermined in different ways. In some embodiments the focal length maybe specified for the entire Fresnel lens and applicable to each sub-zoneof the Fresnel lens. In some embodiments, the focal length of theFresnel lens may be specific to individual zones, sub-zones, or anyother segments or surfaces of the Fresnel lens. Thus different zones,sub-zones, or any other segments or surfaces of the same Fresnel lensmay have different focal lengths.

In order to reduce the space occupied by the optical system providingillumination, the height of the optical system can be reduced, movingthe light source closer to the Fresnel lens. For example, FIG. 1Billustrates an optical system where light source 113 has a distance 115from the same Fresnel lens with symmetric zones 107 that is less thanfocal length 110 for Fresnel lens 107 (which may be less than the focallength distance of the Fresnel lens overall or less than the focallength distance of any one (or more) zones, sub-zones, segments or othersurfaces of Fresnel lens 107). In such a scenario, some of the lightreceived from source 113 may be redirected outside of the field of view(as illustrated by the dash lines coming from lens 107), resulting in anillumination uniformity 119 that is less uniform (e.g., less than 25%uniformity). In this example, the space savings achieved by shorteningthe height of the optical system, resulting in illumination performancethat is inferior to the optical system of greater height, depicted inFIG. 1A.

In order to achieve space savings without losing illuminationperformance, a Fresnel lens with one or more asymmetric zones may beimplemented, in various embodiments. For example, in FIG. 1C, Fresnellens 127 includes asymmetric zones 131 and 133. These asymmetric zonesmay provide localized surfaces that are radially asymmetric, such as theasymmetric surfaces discussed below with regard to FIGS. 2-4. Thus, thesurface at one location in the zone (e.g., the surface of a zone along aradius of 45° of the Fresnel lens) may different than the surface atanother location in the same zone (e.g., the surface of the zone at aradius of 90° of the Fresnel lens). Asymmetric zones allow for Fresnellens 127 to redirect light received at the asymmetric zone from a lightsource 123 that is a distance 125 within the focal length 110 backwithin the field of view, negating some or all of the negative effectsof placing the light source 123 in a location that is out of focus withrespect to Fresnel lens 127 (e.g., light that would otherwise bedirected out of the field of view given the location of light source123, such as is depicted in FIG. 1B). In this way, asymmetric zones 131and 133 may be combined with symmetric zones in Fresnel lens 127 toimplement an optical system that provides an illumination uniformity 129(e.g., greater than 50%) that is similar, comparable, or better than theillumination uniformity of an optical system with an in-focus lightsource (e.g., illumination uniformity 109), while retaining the shorteroptical system height. An optical system with a shorter height can allowsystems, components, or devices, such as a mobile computing device, thatembed or implement the optical system to provide illumination for animage sensor to be thinner without sacrificing illumination performance.

FIG. 2 illustrates a Fresnel lens that includes multiple asymmetriczones, according to some embodiments. Fresnel lens 210 implementsmultiple zones, including asymmetric zone 230 and symmetric zone 240.The selection and placement of asymmetric zones 230 and 231 andsymmetric zones 240 may be relative to the shape and distance of lightsource 220 from Fresnel lens 210 (as determined by the desired opticalsystem height). For example, some zones may be placed fully within thedimensions of a light source so that the outer boundaries of the zone donot extend beyond the light source edges, such as symmetric zone 240 andasymmetric zone 230. In such cases, a zone may be placed so that thezone is inscribed within the light source dimensions so that the outerboundaries of the zone is tangent with one or more light source edges,such as asymmetric zone 230. Zones may also be placed in order topartially overlap with light source dimensions so that at least someportion of the zone is within the light source edges, such as asymmetriczone 231. Partial overlap may be implemented within different ways. Forexample, as depicted in FIG. 2, asymmetric zone 231 may include an outerboundary that is fully outside of the edges of the light source and aninner boundary that is fully within the edges of the light source.Alternatively, in other embodiments, a zone could include an outerboundary that is fully outside of the edges of the light source and aninner boundary that is partially within the edges of the light source,or a zone could include an outer boundary that is partially outside ofthe edges of the light source and an inner boundary that is fully withinthe edges of the light source. Zones may also be placed such that theboundaries of the zone are fully outside of the light source edges, suchas symmetric zone 250.

The selection, arrangement, and characteristics of zones in a Fresnellens may be varied in order to provide a desired illumination pattern oruniformity when the light source is within a focal length of the Fresnellens. The implementation of one zone may guide the implementation ofanother zone. The arrangement of symmetric zones and the way in whichlight is directed by the symmetric zone may illuminate certain portionsof a field of view, and thus may determine the selection, arrangement,and characteristics of one or more asymmetric zones in the Fresnel lens,in order to illuminate other portions in the field of view to achieve adesired illumination pattern or uniformity. Zones that invert light tocross over the center of the Fresnel lens, for instance, may be combinedwith other zones that are non-inverting so that light does not crossover the center of the Fresnel lens, as discussed in detail below withregard to FIG. 4. Zones that include a central region of the Fresnellens may strongly influence the illumination pattern (e.g., a circularillumination pattern) so that one or more zones that are outside of thecentral region may compensate to create a different illumination pattern(e.g., a square illumination pattern). For example, the larger thediameter of the central region, the greater the amount of light isdirected by the central region, which would increase the amount ofcompensation to be provided by asymmetric zones outside of the centralregion in order to modify the illumination pattern.

Although depicted as square, light source 220 could be implemented innon-square shapes (e.g., rectangular, circular, etc.) so that theboundaries of different zones within, overlapping, or outside of lightsource 220 may change. Thus, the illustration of a light source orselection of asymmetric or symmetric zones within Fresnel lens 210 isillustrative, and not intended to be limiting. The size and/or shape oflight source 220 may also guide the implementation of different zones.For instance, the size of the light source may determine the size ofasymmetric zones (as the size of the asymmetric zones may be increasedto compensate for the increased size of the light source), which mayalso determine the size of a central region of the Fresnel lens.Similarly the shape of the light source may determine the shape of theFresnel lens (e.g., a rectangular light source may be focused using ovalshaped segments in a Fresnel lens or a circular light source may befocused using square shaped segments in a Fresnel lens). Note also that,in some embodiments, the height of the optical system may be dependenton the shape of light source 220. For example, system height may be lessthan the source width of light source 220.

In at least some embodiments, the implementation of asymmetric zones,such as asymmetric zone 230 or 231, may be implemented according to asinusoidal pattern so that the variations in asymmetric zone surfacesmay be periodic. For example, a rotational diamond tooling path forshaping a lens segment that can oscillate in a direction (e.g., Z-axis)while rotating along a circumference of the center of the Fresnel lenscan be used to generate a sinusoidal pattern on a surface that maycomplete the pattern every 90°. In this way, a cross section of the lensat 0° including asymmetric zones 230 and 231 would be different than across section of the lens at 45° including zone 230 and 231, asdiscussed below with regard to FIGS. 3A-3C. However, in someembodiments, asymmetry may have no pattern or varying patterns (e.g.,different magnitudes in variation, portions of the zone that have apattern followed by portions of the same zone with no pattern).

The surfaces of an asymmetric zone may be implemented in different waysin order to achieve the redirection of light to different portions of afield of view. FIG. 3A illustrates example cross sections of differentasymmetric zones of a Fresnel lens, according to some embodiments. Zones(e.g., zones 310 a, 310 b, 310 c, and 310 d) of different types (e.g.,asymmetric, symmetric, or heterogeneous (not illustrated)) may bedepicted at a 0° cross section and a 45° cross section. Some zones mayinclude multiple sub-zones, such as zone 310 a which includes sub-zones312 a and 312 b, and zone 310 d which includes sub-zones 312 e, 312 f,and so on, while other zones may include only a single sub-zone, such aszone 310 b which includes sub-zone 312 c and zone 310 c which includessub-zone 312 d.

Different features of the sub-zones may be described in order to definethe changes to the zone surface that may occur in asymmetric zones, insome embodiments. For example, as discussed previously and illustratedin FIG. 3A, each sub-zone may be defined by three different values, aangle with respect to an inner surface of the sub-zone (with respect toa center of the Fresnel lens, which is represented by zone 310 a), insome embodiments. The inner surface may, in some embodiments, act asrefractive surface. The sub-zone may also be described by a β angle withrespect to an outer surface of the sub-zone (with respect to a center ofthe Fresnel lens). The outer surface may, in some embodiments, act as aTIR surface. The outer surface may also be described by a surface radiusR_(O). In other embodiments, a different combination of the same ordifferent measurements may be implemented, such as the height ofsub-zones surfaces (not illustrated).

As noted in the charts accompanying the cross sections, free form zonesmay be described by the different angles and other measures for thesub-zone at the cross section degree (like the 0° and 45° cross sectionsillustrated in the top view of Fresnel lens 210 in FIG. 2). For example,in one example in FIG. 3A, the α angle is illustrated as fixed from onecross section to another, while sub-zone 312 c may have a β angle for asurface that changes from β_(312c) at 0° cross section toβ_(312c)+δ_(312c) at 45° (where δ represents the change in the angle),and in sub-zone 312 d, β angle changes from β_(312d) at 0° cross sectionto β_(312d)−δ_(312d) at 45°. Note that a different sub-zone may have adifferent asymmetry. For instance, sub-zone 312 d is also depicted ashaving a change in surface radius value from γ_(312d) at 0° crosssection to γ_(312d)−ζ_(312d) at 45° (where ζ represents the change inthe angle). In another example illustrated in FIG. 3A, the β angle isillustrated as fixed from one cross section to another, while sub-zone312 c may have an a angle for a surface that changes from α_(312c) at 0°cross section to α_(312c)+δ_(312c) at 45°, and in sub-zone 312 d, αangle changes from α_(312d) at 0° cross section to α_(312d)−δ_(312d) at45° (along with a change in surface radius value from γ_(312d) at 0°cross section to γ_(312d)−ζ_(312d) at 45°).

FIG. 3B illustrates other examples of cross sections of differentasymmetric zones of a Fresnel lens, according to some embodiments. Inone example, the α angle is illustrated as fixed from one cross sectionto another, while sub-zone 312 c may have a β angle for a surface thatchanges from β_(312c) at 0° cross section to β_(312c)+δ_(312c) at 45°,in sub-zone 312 d, where the β angle changes from β_(312d) at 0° crosssection to β_(312d)−δ_(312d) at 45° (along with a change in surfaceradius value from γ_(312d) at 0° cross section to γ_(312d)−ζ_(312d) at45°), and in subzone 312 e, where the β angle changes from β_(312e) at0° cross section to β_(312e)−δ_(312e) at 45°. In another exampleillustrated in FIG. 3B, the β angle is illustrated as fixed from onecross section to another, while sub-zone 312 c may have an a angle for asurface that changes from α_(312c) at 0° cross section toα_(312c)+δ_(312c) at 45°, in sub-zone 312 d, a angle changes fromα_(312d) at 0° cross section to α_(312d)−δ_(312d) at 45° (along with achange in surface radius value from γ_(312d) at 0° cross section toγ_(312d)−ζ_(312d) at 45°), and in sub-zone 312 e, a angle changes fromα_(312e) at 0° cross section to α_(312e)−δ_(312e) at 45°.

FIG. 3C illustrates another example of cross sections of differentasymmetric zones of a Fresnel lens, according to some embodiments. Inone example illustrated in FIG. 3C, the α angle is illustrated as fixedfrom one cross section to another, while sub-zone 312 c may have a βangle for a surface that changes from β_(312c) at 0° cross section toβ_(312c)+δ_(312c) at 45° and a surface radius R_(o) that changes fromγ_(312c) at 0° cross section to γ_(312c)−ζ_(312c) at 45°. Sub-zone 312 dmay have a β angle for a surface that changes from β_(312d) at 0° crosssection to β_(312d)−δ_(312d) at 45° and a surface radius R_(o) thatchanges from γ_(312d) at 0° cross section to γ_(312d)−ζ_(312d) at 45°.Sub-zone 312 e may have a β angle for a surface that changes fromβ_(312e) at 0° cross section to β_(312e)−δ_(312e) at 45° and a surfaceradius R_(o) that changes from γ_(312e) at 0° cross section toγ_(312e)−ζ_(312e) at 45°. In another example illustrated in FIG. 3C, theβ angle is illustrated as fixed from one cross section to another, whilesub-zone 312 c may have an a angle for a surface that changes fromα_(312c) at 0° cross section to α_(312c)+δ_(312c) at 45° and a surfaceradius R_(o) that changes from γ_(312c) at 0° cross section toγ_(312c)−ζ_(312c) at 45°. In sub-zone 312 d, a angle changes fromα_(312d) at 0° cross section to α_(312d)−δ_(312d) at 45° and a surfaceradius R_(o) changes from γ_(312d) at 0° cross section toγ_(312d)−ζ_(312d) at 45°, and in sub-zone 312 e, a angle changes fromα_(312e) at 0° cross section to α_(312e)−δ_(312e) at 45° and a surfaceradius R_(o) changes from γ_(312e) at 0° cross section toγ_(312e)−ζ_(312e) at 45°.

Please note that illustrated measures and changes described forasymmetric zones as discussed above with regard to FIGS. 3A-3C aremerely illustrations of possible changes to implement radial asymmetryin an asymmetric zone and are not intended to be limiting. For example,instead of changing β angle values, a angle values may be changed orboth α and β angle values may be changed. In some embodiments, eachdegree (or portion of a degree) of the lens in a zone (e.g., from 0° to359°) may be individually and/or custom defined, while in otherembodiments a sinusoidal, periodic, or other repeating pattern,function, or description may be used to define the changes to surfacesin the zone. In this way, different portions of a zone or sub-zone mayprovide different characteristics for redirecting light.

Different sub-zones may have different forms of radial asymmetry withina zone. For example, one sub-zone may implement a sinusoidal pattern ofasymmetry while an adjacent sub-zone may implement a non-patterned formof asymmetry. The same pattern of asymmetry may be implemented bydifferent sub-zones at different locations within a zone. For instance,the same sinusoidal pattern may be implemented at two different subzonesso that at any cross section of the sub-zones, the phase of the patternis different. Such differences between asymmetric zones or subzones mayredirect light in different ways. For example, FIG. 4 illustrates aFresnel lens with multiple asymmetric zones that redirect light todifferent portions of a field of view, according to some embodiments.Asymmetric zone 410 may be implemented with different characteristics todirect light to different outer portions in object space. Theredirection of the light may provide non-inverted illumination 412(which may not redirect light across the center of the object space). Inthe same Fresnel lens, asymmetric zone 420 may provide another form ofnon-inverted illumination 422 (e.g., redirecting light to the differentcorners of the object space). In another asymmetric zone in the sameFresnel lens, asymmetric zone 430 may redirect light to provide aninverted illumination 432 (which may redirect light across the center ofthe object space to a common portion of the object space). The combinedredirection of light from the different asymmetric zones (e.g., as wellas other symmetric zones) may enhance the uniformity of the illuminationprovided in object space.

As depicted in FIG. 4 (and FIG. 5 discussed below) multiple Fresnellenses may be combined with different characteristics of zones orsub-zones according to the placement of the Fresnel lens with respect toother Fresnel lenses. In these and other scenarios, different subzonesof the lens may not traverse the entire circumference around the centerof a lens (as illustrated in FIG. 4) but may still be radiallyasymmetric with respect to the center of the lens according to thevarious techniques discussed above, in some embodiments. Moreover, theplacement of different types of sub-zones within a larger zone may shareone common characteristic (e.g., a fixed surface radius R_(o)) butdiffer in terms of radial asymmetry (e.g., a symmetric sub-zone may beadjacent to an asymmetric sub-zone). Different combinations, orderings,and arrangements of one or more Fresnel lenses that utilize radialasymmetry and/or zones (or sub-zones) within the Fresnel lenses mayoffer many different possible illumination patterns, and thus previousexamples are not intended to be limiting.

FIG. 5 illustrates a mobile computing device that implements an embeddedlight module that provides illumination for an image sensor, accordingto some embodiments. Mobile device 502 may be a mobile phone, personaldigital assistant, laptop, notebook, netbook computer, handheldcomputer, consumer device, video game console, handheld video gamedevice, media playback device, storage device, or other computingdevice, such as portable multifunction device 700 discussed below withregard to FIGS. 7A-7C. Image sensor 510 may include one or multipleimage sensor devices (e.g., cameras). For example, image sensor 510 mayinclude a wide-angle camera, telephoto camera, both wide-angle cameraand telephoto camera, or a hybrid camera that is configured to operatein both a wide-angle and telephoto mode.

Light source module 504 may be the same as light source module 604discussed below with regard to FIG. 6 and may be controlled by acontroller, such as controller 602. Light source module 504 includes oneor multiple illumination elements, such as illumination elements 512, 57, 516, and 518, which may be the same or different type of illuminationelement (e.g., such as a light emitting diode (LED) or laser diode), andwhich may be the same or different shape (e.g., square, rectangle,circle, etc.) and/or size of shape (e.g., different size rectangles) andprovide the same or different illumination patterns.

Light source module 504 may include one or multiple Fresnel lenses, suchas Fresnel lens 522, 524, 526, and 528 that are implemented to receivelight from a corresponding one of the illumination elements. TheseFresnel lenses may be implemented in single package, in someembodiments, so that the concentric features, zones, or elements, mayaccount for the redirection properties of other features, zones, orelements on other lenses. For example, Fresnel lens 522 may includeasymmetric zones that redirect light to illuminate portions in a fieldof view that are not illuminated by Fresnel lens 524 or Fresnel lens526. Moreover, each Fresnel lens may implement different numbers and/ortypes of zones (e.g., asymmetric or symmetric) and sub-zones, withdifferent types of radial asymmetry for the asymmetric zones (e.g.,surfaces varied according to the different measures discussed above withregard to FIGS. 3A-3C).

Mobile computing device 502 may utilize light source module 504 toenhance the image data captured by image sensor 510. For example, inorder to illuminate a dark scene, an illumination element may bedirected to emit light. The intensity of light emitted by the lightsource module may be changed or different illumination elements utilizedin order to take advantage of the different illumination effectsprovided by different asymmetric Fresnel lenses in the light sourcemodule, in some embodiments. For example, a controller may receivelighting information from a camera or a light sensor and selectdifferent illumination elements (thus utilizing the correspondingFresnel lens of the selected illumination element) according to lightingconditions in a field of view of a camera associated with a light sourcemodule. In such an example, the image sensor may provide imagesensitivity settings, camera ISO settings, shutter speed settings, etc.to a controller so that the controller can make such a determinationabout which illumination elements (or the intensity of the light emittedfrom the illumination elements) to select in order to better illuminatea scene based on the received lighting condition information.

FIG. 6 illustrates a logical block diagram of a controller and lightsource module, according to some embodiments. A controller, such ascontroller 602, may receive lighting information from an image sensor, acommand from a host system, or other information to determine whichillumination element(s) 614 to instruct to emit light. Controller 602may, for instance, receive a command indicating that particular settinghas been selected for capturing image data (e.g., a scene type), andthus may determine which illumination elements are to be usedcorresponding to the selected scene type. In another example, controller602 may analyze lighting information to determine the intensity of lightto emit from one or more illumination elements 614. Controller 602 maybe implemented in hardware and/or in software. In some embodiments,controller 602 may be implemented by one or more processors and memoryof a mobile device, such as processors 720 and memory 702 of portablemultifunction device 700 as discussed below with regard to FIG. 7C.Controller 602 may send one or more signals to a light source module604, that includes illumination element(s) 614 and Fresnel lens(es) 616,to instruct illumination element(s) 614 to emit light which may then bereceived by Fresnel lens(es) 616 and focused into a space external tolight source module 604.

Embodiments of electronic devices in which embodiments of light sourcemodules, image sensors, etc. as described herein may be used, userinterfaces for such devices, and associated processes for using suchdevices are described. As noted above, in some embodiments, light sourcemodules, image sensors, and controllers, etc. can be included in amobile computing device which can include a camera device. In someembodiments, the device is a portable communications device, such as amobile telephone, that also contains other functions, such as PDA and/ormusic player functions. Other portable electronic devices, such aslaptops, cell phones, pad devices, or tablet computers withtouch-sensitive surfaces (e.g., touch screen displays and/or touchpads), may also be used. It should also be understood that, in someembodiments, the device is not a portable communications device, but isa desktop computer with a touch-sensitive surface (e.g., a touch screendisplay and/or a touch pad). In some embodiments, the device is a gamingcomputer with orientation sensors (e.g., orientation sensors in a gamingcontroller). In other embodiments, the device is not a portablecommunications device, but is a camera device.

In the discussion that follows, an electronic device that includes adisplay and a touch-sensitive surface is described. It should beunderstood, however, that the electronic device may include one or moreother physical user-interface devices, such as a physical keyboard, amouse and/or a joystick.

The device typically supports a variety of applications, such as one ormore of the following: a drawing application, a presentationapplication, a word processing application, a website creationapplication, a disk authoring application, a spreadsheet application, agaming application, a telephone application, a video conferencingapplication, an e-mail application, an instant messaging application, aworkout support application, a photo management application, a digitalcamera application, a digital video camera application, a web browsingapplication, a digital music player application, and/or a digital videoplayer application.

The various applications that may be executed on the device may use oneor more common physical user-interface devices, such as thetouch-sensitive surface. One or more functions of the touch-sensitivesurface as well as corresponding information displayed on the device maybe adjusted and/or varied from one application to the next and/or withina respective application. In this way, a common physical architecture(such as the touch-sensitive surface) of the device may support thevariety of applications with user interfaces that are intuitive andtransparent to the user.

Attention is now directed toward embodiments of portable devices withcameras. FIG. 7B is a block diagram illustrating portable multifunctiondevice 700 with camera 770 in accordance with some embodiments. FIG. 7Billustrates camera 770, which is sometimes called an “optical sensor”for convenience, and may also be known as or called an optical sensorsystem. In addition, multifunction device 700 includes optical sensor764 illustrated in FIG. 7A on an opposite side of multifunction device700 from camera 770.

Referring to FIG. 7C, device 700 may include memory 702 (which mayinclude one or more computer readable storage mediums), memorycontroller 722, one or more processing units (CPU's) 720, peripheralsinterface 718, RF circuitry 709, audio circuitry 710, speaker 711,touch-sensitive display system 712, microphone 713, input/output (I/O)subsystem 706, other input or control devices 716, and external port724. Device 700 may include one or more optical sensors 764. Thesecomponents may communicate over one or more communication buses orsignal lines 703.

It should be appreciated that device 700 is only one example of aportable multifunction device, and that device 700 may have more orfewer components than shown, may combine two or more components, or mayhave a different configuration or arrangement of the components. Thevarious components shown in FIG. 7C may be implemented in hardware,software, or a combination of hardware and software, including one ormore signal processing and/or application specific integrated circuits.

Memory 702 may include high-speed random access memory and may alsoinclude non-volatile memory, such as one or more magnetic disk storagedevices, flash memory devices, or other non-volatile solid-state memorydevices. Access to memory 702 by other components of device 700, such asCPU 720 and the peripherals interface 718, may be controlled by memorycontroller 722.

Peripherals interface 718 can be used to couple input and outputperipherals of the device to CPU 720 and memory 702. The one or moreprocessors 720 run or execute various software programs and/or sets ofinstructions stored in memory 702 to perform various functions fordevice 700 and to process data.

In some embodiments, peripherals interface 718, CPU 720, and memorycontroller 722 may be implemented on a single chip, such as chip 705. Insome other embodiments, they may be implemented on separate chips.

RF (radio frequency) circuitry 709 receives and sends RF signals, alsocalled electromagnetic signals. RF circuitry 709 converts electricalsignals to/from electromagnetic signals and communicates withcommunications networks and other communications devices via theelectromagnetic signals. RF circuitry 709 may include well-knowncircuitry for performing these functions, including but not limited toan antenna system, an RF transceiver, one or more amplifiers, a tuner,one or more oscillators, a digital signal processor, a CODEC chipset, asubscriber identity module (SIM) card, memory, and so forth. RFcircuitry 709 may communicate with networks, such as the Internet, alsoreferred to as the World Wide Web (WWW), an intranet and/or a wirelessnetwork, such as a cellular telephone network, a wireless local areanetwork (LAN) and/or a metropolitan area network (MAN), and otherdevices by wireless communication. The wireless communication may useany of a variety of communications standards, protocols andtechnologies, including but not limited to Global System for MobileCommunications (GSM), Enhanced Data GSM Environment (EDGE), high-speeddownlink packet access (HSDPA), high-speed uplink packet access (HSUPA),wideband code division multiple access (W-CDMA), code division multipleaccess (CDMA), time division multiple access (TDMA), Bluetooth, WirelessFidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and/orIEEE 802.11n), voice over Internet Protocol (VoIP), Wi-MAX, a protocolfor e-mail (e.g., Internet message access protocol (IMAP) and/or postoffice protocol (POP)), instant messaging (e.g., extensible messagingand presence protocol (XMPP), Session Initiation Protocol for InstantMessaging and Presence Leveraging Extensions (SIMPLE), Instant Messagingand Presence Service (IMPS)), and/or Short Message Service (SMS), or anyother suitable communication protocol, including communication protocolsnot yet developed as of the filing date of this document.

Audio circuitry 710, speaker 711, and microphone 713 provide an audiointerface between a user and device 700. Audio circuitry 710 receivesaudio data from peripherals interface 718, converts the audio data to anelectrical signal, and transmits the electrical signal to speaker 711.Speaker 711 converts the electrical signal to human-audible sound waves.Audio circuitry 710 also receives electrical signals converted bymicrophone 713 from sound waves. Audio circuitry 710 converts theelectrical signal to audio data and transmits the audio data toperipherals interface 718 for processing. Audio data may be retrievedfrom and/or transmitted to memory 702 and/or RF circuitry 709 byperipherals interface 718. In some embodiments, audio circuitry 710 alsoincludes a headset jack (e.g., 712, FIG. 7A-B). The headset jackprovides an interface between audio circuitry 710 and removable audioinput/output peripherals, such as output-only headphones or a headsetwith both output (e.g., a headphone for one or both ears) and input(e.g., a microphone).

I/O subsystem 706 couples input/output peripherals on device 700, suchas touch screen 712 and other input control devices 716, to peripheralsinterface 718. I/O subsystem 706 may include display controller 756 andone or more input controllers 760 for other input or control devices.The one or more input controllers 716 receive/send electrical signalsfrom/to other input or control devices 716. The other input controldevices 716 may include physical buttons (e.g., push buttons, rockerbuttons, etc.), dials, slider switches, joysticks, click wheels, and soforth. In some alternative embodiments, input controller(s) 760 may becoupled to any (or none) of the following: a keyboard, infrared port,USB port, and a pointer device such as a mouse. The one or more buttons(e.g., 708, FIG. 7A-B) may include an up/down button for volume controlof speaker 711 and/or microphone 713. The one or more buttons mayinclude a push button (e.g., 707, FIG. 7A-B).

Touch-sensitive display 712 provides an input interface and an outputinterface between the device and a user. Display controller 756 receivesand/or sends electrical signals from/to touch screen 712. Touch screen712 displays visual output to the user. The visual output may includegraphics, text, icons, video, and any combination thereof (collectivelytermed “graphics”). In some embodiments, some or all of the visualoutput may correspond to user-interface objects.

Touch screen 712 has a touch-sensitive surface, sensor or set of sensorsthat accepts input from the user based on haptic and/or tactile contact.Touch screen 712 and display controller 756 (along with any associatedmodules and/or sets of instructions in memory 702) detect contact (andany movement or breaking of the contact) on touch screen 712 andconverts the detected contact into interaction with user-interfaceobjects (e.g., one or more soft keys, icons, web pages or images) thatare displayed on touch screen 712. In an example embodiment, a point ofcontact between touch screen 712 and the user corresponds to a finger ofthe user.

Touch screen 712 may use LCD (liquid crystal display) technology, LPD(light emitting polymer display) technology, or LED (light emittingdiode) technology, although other display technologies may be used inother embodiments. Touch screen 712 and display controller 756 maydetect contact and any movement or breaking thereof using any of avariety of touch sensing technologies now known or later developed,including but not limited to capacitive, resistive, infrared, andsurface acoustic wave technologies, as well as other proximity sensorarrays or other elements for determining one or more points of contactwith touch screen 712. In an example embodiment, projected mutualcapacitance sensing technology may be used.

Touch screen 712 may have a video resolution in excess of 100 dots perinch (dpi). In some embodiments, the touch screen has a video resolutionof approximately 160 dpi. The user may make contact with touch screen712 using any suitable object or appendage, such as a stylus, a finger,and so forth. In some embodiments, the user interface is designed towork primarily with finger-based contacts and gestures, which can beless precise than stylus-based input due to the larger area of contactof a finger on the touch screen. In some embodiments, the devicetranslates the rough finger-based input into a precise pointer/cursorposition or command for performing the actions desired by the user.

In some embodiments, in addition to the touch screen, device 700 mayinclude a touchpad (not shown) for activating or deactivating particularfunctions. In some embodiments, the touchpad is a touch-sensitive areaof the device that, unlike the touch screen, does not display visualoutput. The touchpad may be a touch-sensitive surface that is separatefrom touch screen 712 or an extension of the touch-sensitive surfaceformed by the touch screen.

Device 700 also includes power system 762 for powering the variouscomponents. Power system 762 may include a power management system, oneor more power sources (e.g., battery, alternating current (AC)), arecharging system, a power failure detection circuit, a power converteror inverter, a power status indicator (e.g., a light-emitting diode(LED)) and any other components associated with the generation,management and distribution of power in portable devices.

Device 700 may also include one or more optical sensors or cameras 764.FIG. 7C shows an optical sensor coupled to optical sensor controller 758in I/O subsystem 706. Optical sensor 764 may include charge-coupleddevice (CCD) or complementary metal-oxide semiconductor (CMOS)phototransistors. Optical sensor 764 receives light from theenvironment, projected through one or more lens, and converts the lightto data representing an image. In conjunction with imaging module 743(also called a camera module), optical sensor 764 may capture stillimages or video. In some embodiments, an optical sensor is located onthe back of device 700, opposite touch screen display 712 on the frontof the device, so that the touch screen display may be used as aviewfinder for still and/or video image acquisition. In someembodiments, another optical sensor is located on the front of thedevice so that the user's image may be obtained for videoconferencingwhile the user views the other videoconference participants on the touchscreen display.

Device 700 may also include one or more proximity sensors 766. FIG. 7Cshows proximity sensor 766 coupled to peripherals interface 718.Alternatively, proximity sensor 766 may be coupled to input controller760 in I/O subsystem 706. In some embodiments, the proximity sensorturns off and disables touch screen 712 when the multifunction device isplaced near the user's ear (e.g., when the user is making a phone call).

Device 700 includes one or more orientation sensors 768. In someembodiments, the one or more orientation sensors include one or moreaccelerometers (e.g., one or more linear accelerometers and/or one ormore rotational accelerometers). In some embodiments, the one or moreorientation sensors include one or more gyroscopes. In some embodiments,the one or more orientation sensors include one or more magnetometers.In some embodiments, the one or more orientation sensors include one ormore of global positioning system (GPS), Global Navigation SatelliteSystem (GLONASS), and/or other global navigation system receivers. TheGPS, GLONASS, and/or other global navigation system receivers may beused for obtaining information concerning the location and orientation(e.g., portrait or landscape) of device 700. In some embodiments, theone or more orientation sensors include any combination oforientation/rotation sensors. FIG. 7C shows the one or more orientationsensors 768 coupled to peripherals interface 718. Alternatively, the oneor more orientation sensors 768 may be coupled to an input controller760 in I/O subsystem 706. In some embodiments, information is displayedon the touch screen display in a portrait view or a landscape view basedon an analysis of data received from the one or more orientationsensors.

In some embodiments, the software components stored in memory 702include operating system 726, communication module (or set ofinstructions) 728, contact/motion module (or set of instructions) 730,graphics module (or set of instructions) 732, text input module (or setof instructions) 734, Global Positioning System (GPS) module (or set ofinstructions) 735, and applications (or sets of instructions) 736.Furthermore, in some embodiments memory 702 stores device/globalinternal state 757. Device/global internal state 757 includes one ormore of: active application state, indicating which applications, ifany, are currently active; display state, indicating what applications,views or other information occupy various regions of touch screendisplay 712; sensor state, including information obtained from thedevice's various sensors and input control devices 716; and locationinformation concerning the device's location and/or attitude.

Operating system 726 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, oran embedded operating system such as VxWorks) includes various softwarecomponents and/or drivers for controlling and managing general systemtasks (e.g., memory management, storage device control, powermanagement, etc.) and facilitates communication between various hardwareand software components.

Communication module 728 facilitates communication with other devicesover one or more external ports 724 and also includes various softwarecomponents for handling data received by RF circuitry 709 and/orexternal port 724. External port 724 (e.g., Universal Serial Bus (USB),FIREWIRE, etc.) is adapted for coupling directly to other devices orindirectly over a network (e.g., the Internet, wireless LAN, etc.).

Contact/motion module 730 may detect contact with touch screen 712 (inconjunction with display controller 756) and other touch sensitivedevices (e.g., a touchpad or physical click wheel). Contact/motionmodule 730 includes various software components for performing variousoperations related to detection of contact, such as determining ifcontact has occurred (e.g., detecting a finger-down event), determiningif there is movement of the contact and tracking the movement across thetouch-sensitive surface (e.g., detecting one or more finger-draggingevents), and determining if the contact has ceased (e.g., detecting afinger-up event or a break in contact). Contact/motion module 730receives contact data from the touch-sensitive surface. Determiningmovement of the point of contact, which is represented by a series ofcontact data, may include determining speed (magnitude), velocity(magnitude and direction), and/or an acceleration (a change in magnitudeand/or direction) of the point of contact. These operations may beapplied to single contacts (e.g., one finger contacts) or to multiplesimultaneous contacts (e.g., “multitouch”/multiple finger contacts). Insome embodiments, contact/motion module 730 and display controller 756detect contact on a touchpad.

Contact/motion module 730 may detect a gesture input by a user.Different gestures on the touch-sensitive surface have different contactpatterns. Thus, a gesture may be detected by detecting a particularcontact pattern. For example, detecting a finger tap gesture includesdetecting a finger-down event followed by detecting a finger-up (liftoff) event at the same position (or substantially the same position) asthe finger-down event (e.g., at the position of an icon). As anotherexample, detecting a finger swipe gesture on the touch-sensitive surfaceincludes detecting a finger-down event followed by detecting one or morefinger-dragging events, and subsequently followed by detecting afinger-up (lift off) event.

Graphics module 732 includes various known software components forrendering and displaying graphics on touch screen 712 or other display,including components for changing the intensity of graphics that aredisplayed. As used herein, the term “graphics” includes any object thatcan be displayed to a user, including without limitation text, webpages, icons (such as user-interface objects including soft keys),digital images, videos, animations and the like.

In some embodiments, graphics module 732 stores data representinggraphics to be used. Each graphic may be assigned a corresponding code.Graphics module 732 receives, from applications etc., one or more codesspecifying graphics to be displayed along with, if necessary, coordinatedata and other graphic property data, and then generates screen imagedata to output to display controller 756.

Text input module 734, which may be a component of graphics module 732,provides soft keyboards for entering text in various applications (e.g.,contacts 737, e-mail 740, IM 741, browser 747, and any other applicationthat needs text input).

GPS module 735 determines the location of the device and provides thisinformation for use in various applications (e.g., to telephone 738 foruse in location-based dialing, to camera module 743 as picture/videometadata, and to applications that provide location-based services suchas weather widgets, local yellow page widgets, and map/navigationwidgets).

Applications 736 may include the following modules (or sets ofinstructions), or a subset or superset thereof:

-   -   contacts module 737 (sometimes called an address book or contact        list);    -   telephone module 738;    -   video conferencing module 739;    -   e-mail client module 740;    -   instant messaging (IM) module 741;    -   workout support module 742;    -   camera module 743 for still and/or video images;    -   image management module 744;    -   browser module 747;    -   calendar module 748;    -   widget modules 749, which may include one or more of: weather        widget 749-1, stocks widget 749-2, calculator widget 749-3,        alarm clock widget 749-4, dictionary widget 749-5, and other        widgets obtained by the user, as well as user-created widgets        749-6;    -   widget creator module 750 for making user-created widgets 749-6;    -   search module 751;    -   video and music player module 752, which may be made up of a        video player    -   module and a music player module;    -   notes module 753;    -   map module 754; and/or    -   online video module 755.

Examples of other applications 736 that may be stored in memory 702include other word processing applications, other image editingapplications, drawing applications, presentation applications,JAVA-enabled applications, encryption, digital rights management, voicerecognition, and voice replication.

In conjunction with touch screen 712, display controller 756, contactmodule 730, graphics module 732, and text input module 734, contactsmodule 737 may be used to manage an address book or contact list (e.g.,stored in application internal state 792 of contacts module 737 inmemory 702), including: adding name(s) to the address book; deletingname(s) from the address book; associating telephone number(s), e-mailaddress(es), physical address(es) or other information with a name;associating an image with a name; categorizing and sorting names;providing telephone numbers or e-mail addresses to initiate and/orfacilitate communications by telephone 738, video conference 739, e-mail740, or IM 741; and so forth.

In conjunction with RF circuitry 709, audio circuitry 710, speaker 711,microphone 713, touch screen 712, display controller 756, contact module730, graphics module 732, and text input module 734, telephone module738 may be used to enter a sequence of characters corresponding to atelephone number, access one or more telephone numbers in address book737, modify a telephone number that has been entered, dial a respectivetelephone number, conduct a conversation and disconnect or hang up whenthe conversation is completed. As noted above, the wirelesscommunication may use any of a variety of communications standards,protocols and technologies.

In conjunction with RF circuitry 709, audio circuitry 710, speaker 711,microphone 713, touch screen 712, display controller 756, optical sensor764, optical sensor controller 758, contact module 730, graphics module732, text input module 734, contact list 737, and telephone module 738,videoconferencing module 739 includes executable instructions toinitiate, conduct, and terminate a video conference between a user andone or more other participants in accordance with user instructions.

In conjunction with RF circuitry 709, touch screen 712, displaycontroller 756, contact module 730, graphics module 732, and text inputmodule 734, e-mail client module 740 includes executable instructions tocreate, send, receive, and manage e-mail in response to userinstructions. In conjunction with image management module 744, e-mailclient module 740 makes it very easy to create and send e-mails withstill or video images taken with camera module 743.

In conjunction with RF circuitry 709, touch screen 712, displaycontroller 756, contact module 730, graphics module 732, and text inputmodule 734, the instant messaging module 741 includes executableinstructions to enter a sequence of characters corresponding to aninstant message, to modify previously entered characters, to transmit arespective instant message (for example, using a Short Message Service(SMS) or Multimedia Message Service (MMS) protocol for telephony-basedinstant messages or using XMPP, SIMPLE, or IMPS for Internet-basedinstant messages), to receive instant messages and to view receivedinstant messages. In some embodiments, transmitted and/or receivedinstant messages may include graphics, photos, audio files, video filesand/or other attachments as are supported in a MMS and/or an EnhancedMessaging Service (EMS). As used herein, “instant messaging” refers toboth telephony-based messages (e.g., messages sent using SMS or MMS) andInternet-based messages (e.g., messages sent using XMPP, SIMPLE, orIMPS).

In conjunction with RF circuitry 709, touch screen 712, displaycontroller 756, contact module 730, graphics module 732, text inputmodule 734, GPS module 735, map module 754, and music player module 746,workout support module 742 includes executable instructions to createworkouts (e.g., with time, distance, and/or calorie burning goals);communicate with workout sensors (sports devices); receive workoutsensor data; calibrate sensors used to monitor a workout; select andplay music for a workout; and display, store and transmit workout data.

In conjunction with touch screen 712, display controller 756, opticalsensor(s) 764, optical sensor controller 758, embedded light sourcemodule 775, sensor 776, contact module 730, graphics module 732, andimage management module 744, camera module 743 includes executableinstructions to capture still images or video (including a video stream)and store them into memory 702, modify characteristics of a still imageor video, or delete a still image or video from memory 702.

In conjunction with touch screen 712, display controller 756, contactmodule 730, graphics module 732, text input module 734, embedded lightsource module 775, sensor 776, and camera module 743, image managementmodule 744 includes executable instructions to arrange, modify (e.g.,edit), or otherwise manipulate, label, delete, present (e.g., in adigital slide show or album), and store still and/or video images.

In conjunction with RF circuitry 709, touch screen 712, display systemcontroller 756, contact module 730, graphics module 732, and text inputmodule 734, browser module 747 includes executable instructions tobrowse the Internet in accordance with user instructions, includingsearching, linking to, receiving, and displaying web pages or portionsthereof, as well as attachments and other files linked to web pages.

In conjunction with RF circuitry 709, touch screen 712, display systemcontroller 756, contact module 730, graphics module 732, text inputmodule 734, e-mail client module 740, and browser module 747, calendarmodule 748 includes executable instructions to create, display, modify,and store calendars and data associated with calendars (e.g., calendarentries, to do lists, etc.) in accordance with user instructions.

In conjunction with RF circuitry 709, touch screen 712, display systemcontroller 756, contact module 730, graphics module 732, text inputmodule 734, and browser module 747, widget modules 749 aremini-applications that may be downloaded and used by a user (e.g.,weather widget 749-1, stocks widget 749-2, calculator widget 7493, alarmclock widget 749-4, and dictionary widget 749-5) or created by the user(e.g., user-created widget 749-6). In some embodiments, a widgetincludes an HTML (Hypertext Markup Language) file, a CSS (CascadingStyle Sheets) file, and a JavaScript file. In some embodiments, a widgetincludes an XML (Extensible Markup Language) file and a JavaScript file(e.g., Yahoo! Widgets).

In conjunction with RF circuitry 709, touch screen 712, display systemcontroller 756, contact module 730, graphics module 732, text inputmodule 734, and browser module 747, the widget creator module 750 may beused by a user to create widgets (e.g., turning a user-specified portionof a web page into a widget).

In conjunction with touch screen 712, display system controller 756,contact module 730, graphics module 732, and text input module 734,search module 751 includes executable instructions to search for text,music, sound, image, video, and/or other files in memory 702 that matchone or more search criteria (e.g., one or more user-specified searchterms) in accordance with user instructions.

In conjunction with touch screen 712, display system controller 756,contact module 730, graphics module 732, audio circuitry 710, speaker711, RF circuitry 709, and browser module 747, video and music playermodule 752 includes executable instructions that allow the user todownload and play back recorded music and other sound files stored inone or more file formats, such as MP3 or AAC files, and executableinstructions to display, present or otherwise play back videos (e.g., ontouch screen 712 or on an external, connected display via external port724). In some embodiments, device 700 may include the functionality ofan MP3 player.

In conjunction with touch screen 712, display controller 756, contactmodule 730, graphics module 732, and text input module 734, notes module753 includes executable instructions to create and manage notes, to dolists, and the like in accordance with user instructions.

In conjunction with RF circuitry 709, touch screen 712, display systemcontroller 756, contact module 730, graphics module 732, text inputmodule 734, GPS module 735, and browser module 747, map module 754 maybe used to receive, display, modify, and store maps and data associatedwith maps (e.g., driving directions; data on stores and other points ofinterest at or near a particular location; and other location-baseddata) in accordance with user instructions.

In conjunction with touch screen 712, display system controller 756,contact module 730, graphics module 732, audio circuitry 710, speaker711, RF circuitry 709, text input module 734, e-mail client module 740,and browser module 747, online video module 755 includes instructionsthat allow the user to access, browse, receive (e.g., by streamingand/or download), play back (e.g., on the touch screen or on anexternal, connected display via external port 724), send an e-mail witha link to a particular online video, and otherwise manage online videosin one or more file formats, such as H.264. In some embodiments, instantmessaging module 741, rather than e-mail client module 740, is used tosend a link to a particular online video.

Each of the above identified modules and applications correspond to aset of executable instructions for performing one or more functionsdescribed above and the methods described in this application (e.g., thecomputer-implemented methods and other information processing methodsdescribed herein). These modules (i.e., sets of instructions) need notbe implemented as separate software programs, procedures or modules, andthus various subsets of these modules may be combined or otherwisere-arranged in various embodiments. In some embodiments, memory 702 maystore a subset of the modules and data structures identified above.Furthermore, memory 702 may store additional modules and data structuresnot described above.

In some embodiments, device 700 is a device where operation of apredefined set of functions on the device is performed exclusivelythrough a touch screen and/or a touchpad. By using a touch screen and/ora touchpad as the primary input control device for operation of device700, the number of physical input control devices (such as push buttons,dials, and the like) on device 700 may be reduced.

The predefined set of functions that may be performed exclusivelythrough a touch screen and/or a touchpad include navigation between userinterfaces. In some embodiments, the touchpad, when touched by the user,navigates device 700 to a main, home, or root menu from any userinterface that may be displayed on device 700. In such embodiments, thetouchpad may be referred to as a “menu button.” In some otherembodiments, the menu button may be a physical push button or otherphysical input control device instead of a touchpad.

FIG. 7A-B illustrates a portable multifunction device 700 having a touchscreen 712 in accordance with some embodiments. The touch screen maydisplay one or more graphics within a user interface (UI). In thisembodiment, as well as others described below, a user may select one ormore of the graphics by making a gesture on the graphics, for example,with one or more fingers 701 (not drawn to scale in the Figure) or oneor more styluses 715 (not drawn to scale in the figure).

Device 700 may also include one or more physical buttons, such as “home”or menu button 704. As described previously, menu button 704 may be usedto navigate to any application 736 in a set of applications that may beexecuted on device 700. Alternatively, in some embodiments, the menubutton is implemented as a soft key in a graphics user interface (GUI)displayed on touch screen 712.

In one embodiment, device 700 includes touch screen 712, menu button704, push button 707 for powering the device on/off and locking thedevice, volume adjustment button(s) 708, Subscriber Identity Module(SIM) card slot 710, head set jack 712, and docking/charging externalport 724. Push button 707 may be used to turn the power on/off on thedevice by depressing the button and holding the button in the depressedstate for a predefined time interval; to lock the device by depressingthe button and releasing the button before the predefined time intervalhas elapsed; and/or to unlock the device or initiate an unlock process.In an alternative embodiment, device 700 also may accept verbal inputfor activation or deactivation of some functions through microphone 713.

It should be noted that, although many of the examples herein are givenwith reference to optical sensor/camera 764 (on the front of a device),a rear-facing camera or optical sensor that is pointed opposite from thedisplay may be used instead of or in addition to an opticalsensor/camera 764 on the front of a device.

The methods described herein may be implemented in software, hardware,or a combination thereof, in different embodiments. In addition, theorder of the blocks of the methods may be changed, and various elementsmay be added, reordered, combined, omitted, modified, etc. Variousmodifications and changes may be made as would be obvious to a personskilled in the art having the benefit of this disclosure. The variousembodiments described herein are meant to be illustrative and notlimiting. Many variations, modifications, additions, and improvementsare possible. Accordingly, plural instances may be provided forcomponents described herein as a single instance. Boundaries betweenvarious components, operations and data stores are somewhat arbitrary,and particular operations are illustrated in the context of specificillustrative configurations. Other allocations of functionality areenvisioned and may fall within the scope of claims that follow. Finally,structures and functionality presented as discrete components in theexample configurations may be implemented as a combined structure orcomponent. These and other variations, modifications, additions, andimprovements may fall within the scope of embodiments as defined in theclaims that follow.

What is claimed is:
 1. A mobile computing device, comprising: an imagesensor configured to capture image data for a field of view; a lightsource module embedded in the mobile computing device, the light sourcemodule comprising: a first Fresnel lens comprising a first number ofdifferent zones having respective zone types, the first Fresnel lensconfigured to redirect light received from a first illumination elementto a first portion of a field of view for an image sensor; a secondFresnel lens comprising a second number of different zones, wherein thesecond number differs from the first number or the respective zone typesof the second number of different zones differs from the respective zonetypes of the first number of different zones, the second Fresnel lensconfigured to redirect light received from a second illumination elementto a second portion of the field of view for the image sensor, thesecond portion of the field of view different than the first portion ofthe field of view; the first illumination element and the secondillumination element respectively configured to emit light; and acontroller configured to: cause the first illumination element to emitlight that passes through the first Fresnel lens; and cause the secondillumination element to emit light that passes through the secondFresnel lens.
 2. The mobile computing device of claim 1, wherein thefirst number of different zones of the first Fresnel lens is a differentnumber of zones than the second number of different zones of the secondFresnel lens.
 3. The mobile computing device of claim 1, wherein a firstasymmetric zone of the first Fresnel lens is radially asymmetric,wherein the radial asymmetry of the first asymmetric zone is differentthan a radial asymmetry of a second asymmetric zone of the secondFresnel lens.
 4. The mobile computing device of claim 1, wherein thefirst illumination element is a different shape than the secondillumination element.
 5. The mobile computing device of claim 1, whereinthe first illumination element is located within respective focallengths of the first number of different zones of the first Fresnel lensand wherein the second illumination element is located within respectivefocal lengths of the second number of different zones of the secondFresnel lens.
 6. The mobile computing device of claim 1, wherein one ofthe first number of zones of the first Fresnel lens does not traverse anentire circumference around a center of the first Fresnel lens andwherein a second one of the first number of zones of the first Fresnellens does traverse the entire circumference around the center of thefirst Fresnel lens.
 7. The mobile computing device of claim 1, whereinthe controller is configured to select one of the first illuminationelement or the second illumination element to emit light based, at leastin part, on lighting conditions of the field of view.
 8. A light sourcemodule, comprising: a first Fresnel lens comprising a first number ofdifferent zones having respective zone types, the first Fresnel lensconfigured to redirect light received from a first illumination elementto a first portion of a field of view for an image sensor; a secondFresnel lens comprising a second number of different zones, wherein thesecond number differs from the first number or the respective zone typesof the second number of different zones differs from the respective zonetypes of the first number of different zones, the second Fresnel lensconfigured to redirect light received from a second illumination elementto a second portion of the field of view for the image sensor, thesecond portion of the field of view different than the first portion ofthe field of view; and the first illumination element and the secondillumination element respectively configured to emit light.
 9. The lightsource module of claim 8, wherein the first number of different zones ofthe first Fresnel lens is a different number of zones than the secondnumber of different zones of the second Fresnel lens.
 10. The lightsource module of claim 8, wherein a first asymmetric zone of the firstFresnel lens is radially asymmetric, wherein the radial asymmetry of thefirst asymmetric zone is different than a radial asymmetry of a secondasymmetric zone of the second Fresnel lens.
 11. The light source moduleof claim 8, wherein the first illumination element is a different shapethan the second illumination element.
 12. The light source module ofclaim 8, wherein the first illumination element is located withinrespective focal lengths of the first number of different zones of thefirst Fresnel lens and wherein the second illumination element islocated within respective focal lengths of the second number ofdifferent zones of the second Fresnel lens.
 13. The light source moduleof claim 8, wherein one of the first plurality of zones of the firstFresnel lens does not traverse an entire circumference around a centerof the first Fresnel lens and wherein a second one of the firstplurality of zones of the first Fresnel lens does traverse the entirecircumference around the center of the first Fresnel lens.
 14. Anapparatus, comprising: a first Fresnel lens comprising a first number ofdifferent zones having respective zone types, the first Fresnel lensconfigured to redirect light received from a first illumination elementto a first portion of a field of view for an image sensor; and a secondFresnel lens comprising a second number of different zones, wherein thesecond number differs from the first number or the respective zone typesof the second number of different zones differs from the respective zonetypes of the first number of different zones, the second Fresnel lensconfigured to redirect light received from a second illumination elementto a second portion of the field of view for the image sensor, thesecond portion of the field of view different than the first portion ofthe field of view.
 15. The apparatus of claim 14, wherein the firstnumber of different zones of the first Fresnel lens is a differentnumber of zones than the second plurality of different zones of thesecond Fresnel lens.
 16. The apparatus of claim 14, wherein a firstasymmetric zone of the first Fresnel lens is radially asymmetric,wherein the radial asymmetry of the first asymmetric zone is differentthan a radial asymmetry of a second asymmetric zone of the secondFresnel lens.
 17. The apparatus of claim 14, further comprising thefirst illumination element and the second illumination element, thefirst illumination element and the second illumination elementconfigured to emit light.
 18. The apparatus of claim 17, wherein thefirst illumination element is located within respective focal lengths ofthe first number of different zones of the first Fresnel lens andwherein the second illumination element is located within respectivefocal lengths of the second plurality of different zones of the secondFresnel lens.
 19. The apparatus of claim 17, further comprising acontroller, configured to select one of the first illumination elementor the second illumination element to emit light based, at least inpart, on lighting conditions of the field of view.
 20. The apparatus ofclaim 14, wherein one of the first number of zones of the first Fresnellens does not traverse an entire circumference around a center of thefirst Fresnel lens and wherein a second one of the first number of zonesof the first Fresnel lens does traverse the entire circumference aroundthe center of the first Fresnel lens.